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Box No, I Basis of the report ____ 

1 . With regard to the language, this report is based on the international application in the language in which it was 
filed, unless otherwise indicated under this item. 

□ This report is based on translations from the original language into the following language , 
which is the language of a translation furnished for the purposes of: 

□ international search (under Rules 12.3 and 23.1 (b)) 

□ publication of the international application (under Rule 12.4) 

□ international preliminary examination (under Rules 55.2 and/or 55.3) 

2. With regard to the elements* of the international application, this report is based on (replacement sheets which 
have been furnished to the receiving Office in response to an invitation under Article 14 are referred to in this 
report as ''originally filed" and are not annexed to this report): 



Description, Pages 

1 -27, 30-41 as originally filed 

28, 29 received on 03.10.2005 with letter of 03.10.2005 
Claims, Numbers 

1-26 received on 03.10.2005 with letter of 03.10.2005 
Drawings, Sheets 

1/13-13/13 as originally filed 



□ a sequence listing and/or any related table(s) - see Supplemental Box Relating to Sequence Listing 



3. □ The amendments have resulted in the cancellation of: 

□ the description, pages 

□ the claims, Nos. 

□ the drawings, sheets/figs 

□ the sequence listing (specify): 

□ any table(s) related to sequence listing (specify): 



4. □ This report has been established as if (some of) the amendments annexed to this report and listed below 
had not been made, since they have been considered to go beyond the disclosure as filed, as indicated in the 
Supplemental Box (Rule 70.2(c)). 

□ the description, pages 

□ the claims, Nos. 

□ the drawings, sheets/figs 

□ the sequence listing (specify): 

□ any table(s) related to sequence listing (specify): 

* If item 4 applies, some or all of these sheets may be marked "superseded. " 
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Box No. II Priority 

1 . □ This report has been established as if no priority had been claimed due to the failure to furnish within the 

prescribed time limit the requested: 

□ copy of the earlier application whose priority has been claimed (Rule 66.7(a)). 

□ translation of the earlier application whose priority has been claimed (Rule 66.7(b)). 

2. □ This report has been established as if no priority had been claimed due to the fact that the priority claim has 

been found invalid (Rule 64.1). Thus for the purposes of this report, the international filing date indicated 
above is considered to be the relevant date. 

3. Additional observations, if necessary: 
see separate sheet 



Box No. V Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial 
applicability; citations and explanations supporting such statement 



1. Statement 



Novelty (N) 


Yes: 


Claims 


1-26 




No: 


Claims 




Inventive step (IS) 


Yes: 


Claims 


3,5-12 




No: 


Claims 


1-2,4,13-26 


Industrial applicability (IA) 


Yes: 


Claims 


1-26 




No: 


Claims 





2. Citations and explanations (Rule 70.7): 
see separate sheet 
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1 Reference is made to the following documents (D1 -D4): 
D1 : WO95/30983 (George, Smith) 

D2: David P A M-S; Szczupak J: Refining the digital spectrum. IEEE 39th Midwest 
symposium on Circuits and Systems, Ames, IA, USA 18-21 Aug. 1996. Vol. 2, pages 
767-770. New York, NY, USA.IEEE, US, XP010222730. 

D3: Wim D'haes: A highly optimized nonlinear least squares technique for sinusoidal 
analysis: From '0(K 2 N) to '0(N log(N)). Preprint on the 1 16th Audio Engineering 
Society (AES) Convention, 8-11 May 2004, Berlin, Germany, pages 1-12. 
D4: Mength: "The discrete Fourier Transform". Handout at Stanford University, 09-02- 
2003. XP2275706. 

2 PRIORITY 

The International Search Report contains a P-document (D3), consequently the 
validity of the right to priority should be examined (see the PCT Guidelines, 6.06 (I)). 
Priority is claimed to the document BEW0300207 (further referred to as the priority 
document). 

The right to priority is valid for claims 1 ,2 and 4 only, for the following reasons: 

2.1 The present application discloses "a nonstationary nonharmonic model", which is not 
disclosed by the priority document (renders the priority invalid for claims 3, 5 and all 
claims dependent thereon) 

2.2 The present application discloses that "the parameter A 1 allows to switch between 
different optimization methods and the parameter A 2 regularizes the system matrix", 
which is not disclosed by the priority document (renders the priority invalid for claims 
8-9 and all claims dependent thereon) 

2.3 The present application discloses "a step of computing instantaneous frequencies 
and instantaneous amplitudes", which is not disclosed by the priority document 
(renders the priority invalid for claim 1 1 and all claims dependent thereon) 

2.4 The present application discloses "a step of computing damping factor", which is not 
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disclosed by the priority document (renders the priority invalid for claim 12 and ail 
claims dependent thereon) 

2.5 It should be noted that the right for priority is valid for the subject-matter of claims 

6,7,10,13,14-26 as long as they are dependent on any of claims 1,2 or 4 only, but not 
for claims 6,7,10,13,14-26 as such (since they are also dependent on claims for 
which priority is not valid). 

3 CLARITY 

The application does not meet the requirements of Article 6 PCT, because claims 2- 
9, 13 are not clear. 

3.1 Claims 2,3,5,7 lack the definition of w n , therefore causing lack of clarity. This problem 
could be remedied by defining w n as the window of claim 1 (based on description 
page 2, line 5) 

3.2 Claim 6 claims "determining the number of relevant diagonal bands D". However, it is 
not clear where these diagonal bands can be found. This problem could be remedied 
by including the subject-matter on description page 35, lines 11 to 12. 

3.3 Claims 8-9 lack the definition of the "residual spectrum R m ", therefore causing lack of 
clarity. This problem could be remedied by including the subject-matter on description 
page 17, line 22. 

3.4 Claim 13 lacks the definition of N' and w N M ,, therefore causing lack of clarity. This 
problem could be remedied by including the subject-matter on description page 33, 
lines 22 to 25. 

3.5 The terms close and relevant used in claim 6 are vague and unclear and leave the 
reader in doubt as to the meaning of the technical features to which they refer, 
thereby rendering the definition of the subject-matter of said claim unclear, Article 6 
PCT. 
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3.6 Some of the dependent claims contain features which are not present in every claim 
on which they are based, therefore causing lack of clarity. The problematic claims 
are: 

Claim 4 when dependent on claim 1, referring to "the stationary nonharmonic model" 
and to the "harmonic model". 

Claim 7 when dependent on claim 1 , referring to "the stationary complex amplitudes". 
Claim 8 when dependent on claim 1 , referring to "the stationary nonharmonic model". 
Claim 9 when dependent on claim 1 , referring to "harmonic signal model". 

These problems could be remedied by removing references to claims which do not 
contain the claimed feature. 

3.7 Throughout the set of the claims references are made to equations in the description. 
According to Rule 6.2(a) PCT, claims should not contain such references except 
where absolutely necessary, which is not the case here (since the claims contain the 
equations as well). 

It is suggested that the references to equations be deleted or be put into 
parentheses. 

3.8 Despite the clarity problems mentioned in 3.1-3.7, an examination has been carried 
out in the sense of the above considered corrections. 

4.1 The present application does not meet the criteria of Article 33(1) PCT, because the 
subject-matter of claim 1 does not involve an inventive step in the sense of Article 
33(3) PCT. 

The document D1 is regarded as being the closest prior art to the subject-matter of 
claim 1, and discloses (the references in parentheses applying to this document): 

"A method for modelling, analyzing and/or synthesizing, a windowed signal (page 4, 
lines 15-23; page 10, lines 30-31 in D1), 

by computing the frequencies and complex amplitudes from the signal using a 
nonlinear least squares method" {page 10, line 3 - page 12, line 10 in D1) 
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Document D1 also discloses the problem that sinusoidal modelling is computationally 
expensive (page 3, line 35 - page 4, line 11 in D1). 

The problem to be solved with regard to D1 can therefore be formulated as to make 
the calculation of the model parameters computationally less expensive. 

The skilled person desiring to solve this problem would search further in the prior art 
and he would find document D2. D2 discloses: 

"the computational complexity is reduced by taking into account the bandlimited 
property of the window." {page 770, right-hand column, lines 15-24 in D2) 

The skilled person would combine the documents D1 and D2 since both deal with the 
parameter estimation of a sinusoidal model, therefore obtaining the subject-matter of 
present claim 1 in an obvious way, which therefore does not involve an inventive 
step, hence does not meet the criteria of Art. 33(3) PCT. 

In his letter of reply dated 3.10.2005, the Applicant argues that the application "allows 
the computation of all amplitudes simultaneously" by "solving Eq. (1 9) by an adapted 
gaussian elimination routine", which features are not present in D1 nor in D2. 
However, these features are also not present in claim 1 . Therefore, they cannot be 
taken into account when examining novelty or inventive activity in claim 1 . 
The examiner would like to point out that, for example, the subject-matter of equation 
(1 9) is claimed by present dependent claim 7, not by present independent claim 1 . 

4.2 Dependent claims 2,4,13 do not contain any features which, in combination with 

claim 1 (claims 2 and 1 3) or in combination with claim 2 (claim 4) to which they refer, 
meet the requirements of the PCT in respect of inventive step, the reasons being as 
follows: 

D1 discloses: 

[claim 2]: "a stationary nonharmonic signal model according to Equ. (2)" (page 9, 
equation (10) in D1) 

D2 discloses: 
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[claim 4]: "computation of the spectrum as a linear combination of the frequency 
responses of the window according to equ. (1 1) or (12)" (equation (2) in D2) 

D4 discloses: 

[claim 13]: "the frequency response of the window with length M zero padded up to a 
length N is computed by using a scaled table look-up according to Eq. (82). (Section 
"Zero padding" on pages 6-7 of D4, where D4 represents general background 
knowledge)" 

Consequently the obvious combination of D1 and D2 discloses the subject-matter of 
present claims 2,4 and 13, which therefore do not meet the criteria of Art. 33(3) PCT. 

4.3 The combination of the features of dependent claims 3,5-1 2 is neither known from, 
nor rendered obvious by, the available prior art. A brief indication of the subject- 
matter which renders claims 3,5-12 new and inventive is as follows (for the sake of 
compactness, subject-matter in the equations are indicated by the number of the 
equation only): 

[claim 3]: "a nonstationary harmonic model according to equ. (4)" 

[claim 5]: "computation of the spectrum as a linear combination of the frequency 
responses of the window according to equ. (13)" 

[claim 6]: "determining the number of relevant diagonal bands D" of the matrix B 

[claim 7]: "computing the stationary complex amplitudes, by solving the equations in 
equ. (19)" 

[claim 8]: "optimizing the frequencies for the stationary nonharmonic model by solving 
equation (34)" 

[claim 9]: "computing the optimization step by solving equ. (48) by using equ. (49)" 
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[claim 10]: "computing the polynomial complex amplitudes by solving equ. (55)" 

[claim 11]: "computing instantaneous frequencies and instantaneous amplitudes 
according to equ. (69)" 

[claim 12]: "computing damping factor according to equ. (78)" 

4.4 Dependent claims 14-16, 19-22 do not contain any features which, in combination 
with claims 1 ,2,4 or 13, to which they refer, meet the requirements of the PCT in 
respect of inventive step, the reasons being as follows: 

[claim 14], when dependent on any of claims 1,2,4,13: "Apparatus adapted to carry 
out each and every step according to any of claim 1-13" (The methods of claims 
1,2,4, 13 are not inventive, hence neither is an apparatus implementing them) 

[claims 15-16], when dependent on any of claims 1,2,4,13: "for accurate pitch 
estimation (page 5, lines 11 to 12 in D1)" 

[claims 19-20], when dependent on any of claims 1,2,4,13: "for parametric/sinusoidal 
audio coders" (Fig. 1, 17, 28 in D1) 

[claims 21-22], when dependent on any of claims 1 ,2,4,13: "for audio effects" (claim 3 
inD1) 

4.5 Claims 1 7-1 8, 23-26 do not meet the requirements of Article 6 PCT in that the matter 
for which protection is sought is not clearly defined. The claims attempt to define the 
subject-matter in terms of the result to be achieved, which merely amounts to a 
statement of the underlying problem, without providing the technical features 
necessary for achieving this result. 

5.1 Contrary to the requirements of Rule 5.1 (a)(ii) PCT, the relevant background art 
disclosed in the documents D2 and D3 is not mentioned in the description, nor are 
these documents identified therein. 
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from which follows that the expressions of Eq. (56) can be transformed to 
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(59) 



The vectors C and matrices B are now expressed in terms of the frequency response of the 
windows and the square window respectively. Each (p t g)-couple denotes a submatrix of the 
matrices of size KxK. From the bandlimited property of R[Y(rn)} and its derivatives follows ' 
that these submatrices of B 11 and B 2,2 are band diagonal. In an analogue manner, since 
Q[y(m)] and its derivatives always yield zero, the submatrices B 12 and B 2 * 1 contain only 
zeros. This structure is depicted at the top of Figure 10. 

The upper left and lower right kwadrants contain band diagonal submatrices for each 
(?» <?)-couple. This implies that all relevant values are stored at positions defined by a quadru- 
ple (J, q, fc,p) for which the following conditions hold: 



-D < k— I < D 
0<p< F-l 
0 < q < P- 1 

The inequalities given in Eq. (60) can be transformed to 

-DP < (fc - l)P < DP 
0<p<P-l 
-(P-l) < ~q < 0 



(60) 



(61) 
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from which follows that 



■{D + 1)P + 1 < (JbP + p) - (IP + q) < (£> + l)P-l 



(62) 



By inverting the indexation order, i.e. using (kP + p, IP + q) instead of (pK -f k,qK + Z), 
one obtains for the row index kP + p and for the column index IP + q. Since their difference 
denotes the index of the diagonal, it follows from Eq. (62) that all relevant values lie around 
the main diagonal. This is illustrated by the lower part of figure 10. A a result, the definition 
of the system of equations after inversion of the indexation becomes 
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(63) 



By using a look-up table for each derivative of the frequency response each element can be 
computed in constant time. Since B 1 ' 1 and B 2 ' 2 are band diagonal they can be stored in a 
more compact form containing only the relevant diagonal bands, yielding 



B l,i i 



= B 
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(64) 



with p and q ranging from 0 to P — 1, I ranging from 0 to K — 1, and k from 0 to 2D. 
Conclusion 

A least squares method is derived which allows to analyse non stationary sinusoidal com- 
ponents defined by Eq.(50). This model for a windowed signal of length N, consists of K 
sinusoidal components with complex polynomial component of order P. When the equa- 
tions are solved in the time domain the computation of the system matrix has a complexity 
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CLAIMS (Retyped) 



1. A method for modelling, analyzing and/or synthesizing, a windowefrvdi4lKVby 
computing the frequencies and complex amplitudes from the signal using a nonlinear 

5 least squares method, whereby the computational complexity is reduced by taking . into 
account the bandiimited property of the window. 

2. A method according to claim 1 using a stationary nonharmonic signal model 
according to Eq. (2), which is a model with K stationary components where each 

1 0 component is characterized by its complex amplitude A k and frequency a>* 



K-l 



ID, 



(2) 



~ or a harmonic signal model according to Eq. (3), which is a model with S quasi-periodic 
stationary sound sources with a fundamental frequency o) ki each consisting of S k 
1 5 sinusoidal components with frequencies that are integer multiples of u*. and in which the 
complex amplitude of the plh component of the &th source is denoted A kiP 

t YL Ah * exp(-2 7 rzpij fc 3i-i ! i) (3) 

k=0 p=0 



3. A method according to claim 1 using a nonstationary nonharmonic model 
20 according to Eq. (4), which is a model with K nonstationary sinusoidal components 
which have independent frequencies o) k) and in which the amplitudes A ktP denote the/?- 
th order of the k-tirt sinusoid 



= 3ft 



K-l P-i 
k=0 p=0 



(4) 



25 4. A method according to claim 1 or 2, comprising the computation of .the spectrum 
as a linear combination of the frequency responses of the window according to Eq. (11) 
for the stationary nonharmonic model, 



1 
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K-l 



x m = E* w ( m+Wfc ) 



(11) 



fc=0 



or Eq. (12) of the harmonic model 



(12) 



A«=Q p=0 



where the fourier transform of a complex signal results in a spectrum ^m, where W(m) 
denotes the discrete time fourier transform of w n and whereby only the main lobes of the 
responses are computed by using look-up tables 

10 5. A method according to claim 3, comprising the computation of the spectrum as a 
linear combination of the frequency responses of the window according to Eq. (13) for 
the nonstationary model, 



AT-1 
n=0 

K-lP-l 

- EE**' 

fc=0 p=Q 
K-l P-l 



exp(-27rzm^p) 



n— 0 



- EE*.^^+™) (13) 

fc=0 p=0 

15 where the fourier transform of a complex signal results in a spectrum Xm, where fFfm,) 
denotes the discrete time fourier transform of w n whereby only the main lobes of the 
responses are computed by using look-up tables. 

6. A method according any of claim 1 to 5, comprising a pre-processing step which 
20 comprises: sorting the frequencies, eliminating frequencies which are close to one 
another and determining the number of relevant diagonal bands D. 



7. A method according any of claim 1 to 6, comprising the step of computing the 
stationary complex amplitudes, by solving the equations given in Eq. (19), 
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B 1 ' 1 B 1 ' 2 
B 2 - 1 B 2 - 2 
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(19) 



where 



N-l 



B$ = ^^cos(27rwjfe^)cos(27raj 2 s^!tt) 

n=0 
N-l 

= ^^cos(27rtu fc !^)sin(27iW|2^ft) 

N-l 
N-l 
N-l 

C? = ^z n w n sin(27ra;i^) 



n=0 



5 using Eq. (20) 



n=0 



0/ 



(20) 



such that only the elements around the diagonal of B are taken into account, whereby a 
shifted form B is computed containing only D diagonal bands of B according to Eq. (27) 



10 
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and Eq. (20), whereby the computation of the Eq. (20) requires the computation of the 
frequency response of the window and the square window denoted by W(m) and Y(m) 
respectively, and solving equation given by Eq. (19) directly from B and C in Eq. (28) 

A r = SOLVE(B^ ) C 1 ) 

A^SOLVE^tC 2 ) (28) 

b 

by an adapted gaussian elimination procedure. 

8. A method according to any of claim 1, 2, 4, 6 and 7, further comprising the step 
of optimizing the frequencies for the stationary nonharmonic model by solving the 
10 equation given in Eq. (34) 

HAw = h . (34) 



15 



, using Eq. (42) 



(42) 



such that only elements around the diagonal of H are taken into account, whereby a 
shifted form H is computed containing only D diagonal bands according to Eq. (36) 

H lk = H lHk - D ■ (36) 

and Eq. (42), whereby the gradient h is computed from the residual spectrum R mi 
20 amplitude At and frequencies w/, and requires the computation of derivative of the 
frequency response of the window W(m) 9 whereby the first term of H requires the 
computation of the second derivative of the frequency response of the square window 
denoted Y"(m) t whereby the second term of H is computed from the residual spectrum 
Rm> amplitude Ai and frequencies to/, and requires the computation of the second 
25 derivative of the'frequency response W"(m) % whereby the parameter >m allows to switch 
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between different optimization methods and the parameter X2 regularizes the system 
matrix, and computing the optimization step by solving the system of equations directly 
oh Hand h according to Eq. (37) 

AiD = SOLVE(H,h) (37) 
by an adapted gaussian elimination procedure. 

9. A method according to any of claim 1, 2, 4, 6 and 7, further comprising the step 
of optimization the frequencies for the harmonic signal model, by computing the 
optimization step solving Eq. (48) using Eq. (49), 

HAo> = h (48) 



with 



Si-l /N-l 
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whereby the gradient h is computed from the residual spectrum R nu amplitude A\ and 
frequencies w/, and requires the computation of derivative of the frequency response of 
the window W'(m), whereby the first term of H requires the computation of the second 
15 derivative of the frequency response of the square window denoted Y"(m), whereby the 
second term of H is computed from the residual spectrum Rm t amplitude A/ and 
frequencies co/, and requires the computation of the second derivative of the frequency 
response W"(m), -whereby the parameter Xj allows to switch between different 
optimization methods and the parameter X 2 regularizes the system matrix. 
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10. A method according to any of claim 1 to 9, further comprising the step of 
computing the polynomial complex amplitudes by solving the equation given in Eq. (55), 



(55) 



" B 1,1 


B 1 ' 2 




" A 1 " 




c 1 " 


B 2 ' 1 


B 2 ' 2 




A 2 




c 2 



5 using Eq. (63) 



p2,l 

^IP+qfiP+p 



B 2 ' 2 

■UlP+^kP+p 



^IP+q 



G lP+q 



d p + q 



d p + q 



+<-ir»5 



dm?+i 



U[Y(m)]] 



dmP*<* 



QP+Q 



R[K(m)] 



R[y(m)]] 



\ rn-Q / 
\ m=0 / 



A k, P 



A 2 — A\ 



(63) 



such that only the elements around the diagonal of B are taken into account, whereby a 
shifted form B is computed containing only PD diagonal bands of B according to Eq ; 
(64) 



1,1 = RM 

fP+ g ,lP+ 9 +fcP+p-(£M-l)P+l 

2,2 



p iP+g,(/c+/-X))P+(p+g~P+l) 



2,2 



(64) 



lP+q t kP+p — ^ip +9) /p +9+ jfep +p _(D + i)p + i ~ •^iP + g J (A+i-D)p + (p +g _p+i) 

and Eq. (63), whereby the computation is required of the frequency response of the 
square window and its derivatives whereby the computation is required of the 

frequency response of the window and its derivatives £* w ( m \ and solving the equation 
given by Eq. (55) directly from B and C by an adapted gaussian elimination procedure. 



15 



6 
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11. A method . according to any of claim 1 to 10, further comprising the step of 
computing instantaneous frequencies and instantaneous amplitudes according to Eq. 
(69), 



\ 



P-l \ 2 /P-l \ Z 

p=0 / \p=o 1 / 



**(n) - 

$fc(n) = 2iriu) k 2^p -Harcfcan 



whereby the instantaneous frequency can be used as a frequency estimate for the next 
iteration as expressed in Eq. (73) 



AT Ai __ Ai At 
fc ~ k Ai 2 _l_ AT 2 ^ ' 



12. A method according to any of claim 1 to 11, further comprising the step of 
1 0 computing damping factor according to Eq. (78), 

Pk « + (78) 

in case that the amplitudes are exponentially damped. 

13. A method according to any of claims 1 to 12 the frequency response of the 
15 window with length Mzero padded up to a length AHs computed using a scaled table 

look-up according to Eq. (82) 

m~0 



— wjj, (n -ni) = -X) W < AF m ~ mo) exp ( 2?rz N> ) (82) 



14. Apparatus adapted to carry out each and every step of the method according to 
20 any of the previous claims 1 to 13. 

15. Use of a method according to any of the claims 1 to 13 for accurate pitch 
estimation 

25 16. Use of an apparatus according to claim 14 for accurate pitch estimation. 
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17. Use of a method according to any of the claims 1 to 13 for arbitrary sample rate 
conversion. 

18. Use of an apparatus according to claim 14 for arbitrary sample rate conversion. 

5 

19. Use of a method according to .any of the claims 1 to 13 for parametric/sinusoidal 
audio coders, where the noise residual, amplitudes and frequencies are encoded in a 
bitstream which is stored, broadcasted or transmitted at the sender side, the receiver 
decodes the bitstream back to the parameters and synthesizes the sound 

10 

20. Use of an apparatus according to claim 14 for parametric/sinusoidal audio 
coders, where the noise residual, amplitudes and frequencies are encoded in a 
bitstream which is stored, broadcasted or transmitted at the sender side, the receiver 
decodes the bitstream back to the parameters and synthesizes the sound. 

15 

21 . Use of a method according to any of the claims 1 to 13 for audio effects whereby 
the noise r ni the amplitudes A and frequencies & are manipulated by an effects 
processor yielding r n> A* and ^*and synthesized with these modified parameters. 

20 22. Use of an apparatus according to claim 14 for audio effects whereby the noise r n , 
the amplitudes A and frequencies are manipulated by an effects processor .yielding 
r n> A* anc j a)* and synthesized with these modified parameters. 

23. Use of a method according to any of the claims 1 to 13 for source separation, 
25 whereby sinusoidal components originating from the same sound source are grouped 

and synthesized separately. 

24. Use of an apparatus according to claim 14 for source separation, whereby 
30 sinusoidal components originating from the same sound source are grouped and 

synthesized separately. 
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25. Use of a method according to any of the claims 1 to 13 for automated annotation 
and transcription whereby the signal is segmented according to the values of the 
amplitudes and frequencies 

26. Use of an apparatus according .to claim 14 for automated annotation and 
transcription whereby the signal is segmented according to the values of the amplitudes 
and frequencies. 
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